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Abstract 

When making the connection between the thermodynamics of ir- 
reversible processes and the theory of stochastic processes through 
the fluctuation-dissipation theorem, it is necessary to invoke a postu- 
late of the Einstein-Boltzmann type. For convective processes hydro- 
dynamic fluctuations must be included, the velocity is a dynamical 
variable and although the entropy cannot depend directly on the ve- 
locity, 5 2 S will depend on velocity variations. Some authors do not 
include velocity variations in 5 2 S, and so have to introduce a non- 
thermodynamic function which replaces the entropy and does depend 
on the velocity. At first sight, it seems that the introduction of such 
a function requires a generalisation of the Einstein-Boltzmann rela- 
tion to be invoked. We review the reason why it is not necessary to 
introduce such a function, and therefore why there is no need to gen- 
eralise the Einstein-Boltzmann relation in this way. We then obtain 
the fluctuation-dissipation theorem which shows some differences as 
compared with the non-convective case. We also show that 5 2 S is a 
Liapunov function when it includes velocity fluctuations. 



1 INTRODUCTION 



Velocity fluctuations play an important role in a variety of non-equilibrium 
phenomena. Mention can be made, for instance, of time dependent diffusion 
processes in binary liquid mixtures, where they are the principal mechanism 
leading to anomalously large fluctuations in concentration pp. Also, the 
coupling between temperature and transverse- velocity fluctuations in the well 
known case of a horizontal fluid layer heated from below may be associated 
with a small convective heat transfer below the Rayleigh-Benard instability 
[2]. It is natural to consider these kind of problems from the point of view 
of irreversible thermodynamics. However, there is no prescription for how to 
introduce the velocity fluctuations into the formalism. 

The standard method of introducing fluctuations into irreversible thermo- 
dynamics is through the Einstein-Boltzmann relation P$ ~ exp {S 2 S/2kB}, 
where P5 is the stationary probability distribution and 5 2 S is the second 
variation of the local entropy [3J. In this paper we will be interested in con- 
vective processes where the velocity is included as a dynamical variable, and 
in the explicit form for 5 2 S in this case. It should be noted, and is widely 
appreciated, that the entropy does not depend directly on the velocity of 
the system: velocity is a hydrodynamic, but not a thermodynamic variable. 
Therefore some authors, notably Glansdorff and Prigogine [4J, do not include 
velocity variations in the expression for 5 2 S. 

A solution to this problem could be to introduce a new function which 
is essentially a generalisation of the entropy which does depend on the ve- 
locity. This would not be a thermodynamic function, but it would then be 
necessary to generalise the Einstein-Boltzmann relation in such a way that 
entropy would be replaced by this new function. Such a function has been 
introduced some time ago by Glansdorff and Prigogine, but in the context 
of thermodynamic and hydrodynamic stability [I]. They suggested defining 
a new function z = s — v 2 /2To, where s is the entropy per unit mass, v is 
the barycentric velocity and T is the temperature in the reference state (for 
example, the temperature in equilibrium). The analogous quantity for the 
system as a whole will be denoted by Z and is given by Z = J pzdV, just as 
S = J psdV. This function has not been utilised a great deal, perhaps in part 
because among those who explicitly use the Z-function [I]- [I], most do not 
consistently use the definition given above, sometimes using the (varying) 
temperature T in place of the (non-varying) reference temperature T . 

The main reason why the function Z has not been widely used is no 
doubt the demonstration by Oono [6j that 5 2 S does in fact contain velocity 
variations, even though the entropy does not depend on the velocity. In fact, 
the entropy may be written in terms of the velocity if other variables are 
introduced which exactly cancel out the velocity dependence To see this 
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let us write |6j 

dU = TdS - pdV + // 7 diV 7 , (1) 

where U is the internal energy, V the volume, iV 7 the number of moles of 
the 7-chemical species, p the pressure, and /i 7 the chemical potential of the 
7-species. In addition, let Et be the total energy: 

E T = U + mv^/2, (2) 

being the barycentric velocity and m the mass. We assume that the 
changes in potential energy due to altitude, for instance, are negligible. 
Therefore we omit a potential term in this definition. Then Eq. flTJ can 
be written as 

dEx = TdS — pdV + // 7 diV 7 + mv^dv^. (3) 

Now note that in Eq. ([3]) the term dET — mv^dv^ does not depend on velocity 
in accordance with the definition of the total energy Eq.([2]). So the entropy in 
Eq. ([3]) does not depend on the velocity and the thermodynamic consistency 
of this form of Gibbs relation Eq.([T]) is ensured. 

Oono also showed that 5 2 Z is nothing else but 5 2 S. However, mention 
must be made of the fact that 5 2 S and S 2 Z are only equal within approxima- 
tion schemes where T can be replaced by T . There is also a lack of consensus 
as to whether S 2 S is a Liapunov function in systems where velocity is a dy- 
namical variable: some authors believe it is |9], others believe it is not [I]. 
Some of this confusion involves matters of principle, some involves matters of 
notation (for instance, S 2 S meaning two entirely different things), and some 
involves inconsistencies in definitions of key quantities. Our objective in this 
paper is to clarify many of these points, by examining their consequences in 
the context of linear theories of irreversible thermodynamics, and to obtain 
the explicit form of the fluctuation-dissipation theorem for convective pro- 
cesses. We remark in passing that there are a whole set of different subtleties 
and controversies in extending these ideas to the non-linear regime [5], [10] , 
but we do not explore these here. 

2 IRREVERSIBLE THERMODYNAMICS AND 
STOCHASTIC PROCESSES 

A fluid being described within linear irreversible thermodynamics (LIT) re- 
quires five local variables: the volume per unit mass v , the barycentric ve- 
locity v fj, and the temperature T [3] , but our conclusions will be more widely 
applicable, for example applying also to a fluid in extended irreversible ther- 
modynamics (EIT), which requires 14 dynamic variables To keep the 
notation general, we will denote the fluctuations in the independent dynamic 
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variables as a b (r, t), where b = 1, . . . , N and assume that they satisfy a set 
of Langevin-type equations: 



da b {r,t) 
dt 



J dv'G bc (r,r')a c (r\t) + f b (r,t). (4) 



Here the first term on the right-hand side is a result of the linearization of the 
macroscopic equation about the stationary state and /&(r, t) is a stochastic 
term that represents fluctuations in the system. For the particular case of a 
fluid within LIT N = 5 and the five local variables a±, . . . , as are the scaled 
versions of fluctuations in {?;, t^, T}. Specifically if the equilibrium state is 
denoted by {f ,0,T }, and fluctuations away from this state by {v 1 ,v^,T 1 }, 
then we define the a b by [9j [12]: 

a l = -P§Vl , <V+i = — v l* ' °5 = I jT^T J T l ' ( 5 ) 

with fi = 1, 2, 3. Here p is the mass density, ct the isothermal speed of 
sound and C v the specific heat at constant volume, all in equilibrium. These 
rescalings simplify the algebraic structure of the results. We use the same 
notation for the velocity and the velocity fluctuations, since no confusion 
should arise. 

The analysis of the fluctuations is made more transparent if we adopt an 
abbreviated form where the continuous labels r and r' are replaced by the 
discrete labels j and k and where the summation convention is assumed. In 
this case, (TJ]) becomes 

ai(t)+Gi k c a k c (t) = fl(t); b,c=l,...,N. (6) 

To complete the specification of the stochastic dynamics, the statistics of 
the stochastic terms f b (t) need to be given. We will take them to have a 
Gaussian distribution with mean zero and correlator 

f b (t)fc(t')) = 2Qi k c 5(t-t'). (7) 

The requirement that they have zero mean follows from the fact that we ask 
that the a b have zero mean: (a J b ) = 0. The matrix Q is real, symmetric and 
positive semidefinite. We will not give an explicit form for the matrix G here: 
it may be straightforwardly derived by a linearization of the macroscopic 
equations [9]. As will be discussed below, the matrix Q may be given in 
terms of the matrix G and another matrix E, which is the covariant matrix 
of the a£ in the stationary state: 

{a l e af) s = (E- 1 )%. (8) 
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Therefore the stochastic dynamics will be completely specified if we can de- 
termine the matrix E. Clearly we need some new information from which to 
find it. This is the Einstein-Boltzmann relation. 

The Gaussian assumption determines the class of phenomena to be dealt 
with. In general, the Gaussian assumption is valid for a wide range of condi- 
tions in which the physical variables do not change too fast with time [3]. It 
may be said that the sufficient condition for the validity of this assumption is 
the local equilibrium hypothesis. Nevertheless, the system may be in a non- 
equilibrium non-stationary state in which such a hypothesis is not satisfied 
and yet will be well described throughout using the Gaussian assumption. 

We now introduce the fluctuation-dissipation theorem by recalling that 
another way of specifying the stochastic process defined by Eqs. §6§ and (J7J) 
is through the Fokker-Planck equation [TU [15] 

dP(a, t) d 
dt ~ dd 



G{y c P{*, tj\ + -S— [Q£p(a, t)] , (9) 



b uu b uu 1( . 



where -P(a, t) is the probability distribution function of the local variables 
a. This is a linear Fokker-Planck equation and so the solution is a Gaussian 
which may be written down explicitly as 



P(a,t) = jV (detE(t)) 



x exp<!--a T H(t)- 1 aL (10) 
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where M is a normalisation constant and where the matrix H(t) is given by 

ft 

i to 



E{t - t ) = 2 f e-^ G Q e^ G dt' . (11) 

Jto 



Here initial conditions have been set at t — to and we have made use of the 
fact that (a J b ) = 0. By letting to ~~ * — oo, we find the stationary distribution. 
It has the form (jTUJ), but with H(t) replaced by 



S(oo) = 2 / e-WQeWtf 

J —oo 

POD 

= 2 / e- pG Qe pG dp. (12) 
Jo 

To make use of the Einstein-Boltzmann relation, let us observe that since 
the a b have zero mean, and since they are linearly related to the fjf which 
are Gaussian, they also have a Gaussian distribution with a stationary prob- 
ability distribution of the form: 

P 5 (a)=Afexp{-ia^^}. (13) 
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Here a = (a 1 , a 2 , . . .) where a 1 = (a\, . . . , a l N ) and Af is a normalisation 
constant. By comparing (ITS]) with (11 01) when t ~~ > — oo, we can make the 
identification 

E- 1 = H (oo) =2 1 e~ pG Q e pG dp . (14) 
Jo 

Performing the integral in (fT4"j) gives the result [16] 

= Gt{E- l fi + (E-y^ , (15) 

where T denotes transpose. This is the fluctuation-dissipation theorem of 
the theory. It is the required relationship which gives the matrix Q in terms 
of the matrices G and E. 



3 THE FLUCTUATION-DISSIPATION THEOREM 
FOR CONVECTIVE SYSTEMS 

The result (I13p may be compared directly [12] with the Einstein-Boltzmann 
relation 

P s {*)~exv{PSl2k B } , (16) 

so that 

5(a) = S cq - l -k B a{El k c a k c . (17) 

The indices h and c in (|T3|) or (jTTj) run from 1 to N (from 1 to 5 in LIT) 
and include the velocity as a variable. However, if only specific volume (or 
density) and temperature are included as variables in 5 2 S [H [13], then it 
apparently seems that Eqs. (|T3l) and (|T6l) cannot be compared to determine 
the matrix. Thus, it seems clear that the 5 2 S which we need to use in 
the Einstein-Boltzmann relation is the one which allows for variations in the 
velocity. In fact, as shown by Oono [6], 

= 5ll)5U + s(l) 5V- mSv ^ 

(18) 



T J \TJ T 



6 2 S 



T 



where 5 2 S\ V is 5 2 S with no variation in the velocity. Using 5 2 S, rather than 
5 2 S\ V allows Eqs. (TT3|) and ([TBI) to be compared and the matrix E determined. 
It should be noted that (i) in Ref. [12] the additional term to be added to 
5 2 S\ V was given as mdv^^—v^/T), and (ii) in Ref. [6] it was stated that 
S 2 Z = 5 2 S — whereas from the definition of z we see that 



s<z = rs "" UJr 



7^- (19) 

in 
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Both the results (i) and (ii) are true in the linear regime, where T _1 may be 
replaced by Tq 1 , but they are not true in general; the correct form for S 2 S 
is given in Eq. (JIB]) , and 5 2 Z is not equal to 5 2 S, it is given by Eq. f|T9|) . 
A consequence of this is that in the linear regime the Einstein-Boltzmann 
relation may also be written as Ps ~ exp {5 2 Z/2kB}- This means that if we 
were to use S 2 S\ V , as Glansdorff and Prigogine do, we would need to invoke 
this latter form of the Einstein-Boltzmann relation to identify the matrix E 
and so make the connection between irreversible thermodynamics and the 
theory of stochastic processes, at least in the linear regime. However, as we 
have stressed there is no need to introduce this extra postulate, and we may 
use the usual form P s ~ exp {5 2 S/2k B }, as long as the correct form of S 2 S 
(USD is used. 

We can now come back to the task of determining the matrix E. Let us 
first write down the expression for 5 2 S without velocity variations in terms of 
the scaled versions of v\ and T\, namely a\ and to see explicitly where the 
process fails. After some straightforward manipulations [12] of this standard 
result [T3], we obtain, using the Einstein-Boltzmann relation, 

P s (a) ~ exp J [-a{a{ - 44] J . (20) 



If this result were to be compared with (U3l) then it would imply that E would 
be diagonal, but with entries corresponding to the velocity fluctuations being 
zero. This is clearly not correct since, for instance, the velocity-velocity 
correlation function in equilibrium (jSJ) would be formally infinite. Using 
instead the form of 5 2 S allowing for velocity variation we find 

P s (a) ~ exp | [-44] | , (21) 

since t> M = (c^/po)^ 2a ^+i and where 6 = 1, 5. A comparison with (jSj) gives 
the identification 

El k c =^-5 3k 5 bc . (22) 

This now gives a consistent result, which when used in conjunction with 
the fluctuation-dissipation theorem (fT5|) . completely specifies the stochastic 
dynamics described by and ([7]) or by (Q. An explicit expression for 
matrix Q is obtained by substituting Eq. (1221) into Eq. (|T5l) . The result is 

C&=^S». (23) 
where S( k represents the symmetric part of the dynamic matrix G: 

Wi( r >0 = y o + OVU q^t 5( ? ~ r ') > ( 24 ) 
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1 d 2 

with all other Sf, c (r, r ; ), including Su(r, r'), 
is defined by 



5(r - r') , (25) 
equal to zero. The tensor X^ upa 



X 



[iv pa 



S„rr + 5, lfT 5 



fia w up 



Is & 

g °p,v°pa 



(26) 



In Eqs. f[2~41) and f[2"5l) . the continuum limit has been taken so that the discrete 
spatial variables j, k have been replaced by r, r'. As mentioned above, all 
the matrices in Eq. (|T5|) are 5 x 5 in the convective case, unlike in the non- 
convective case where they are 2x2. 

The discussion above took place within the framework of LIT which con- 
tains 5 dynamical variables, but the idea is more general. We have already 
mentioned EIT where the dissipative fluxes are raised to the same status as 
the thermodynamic variables. In this case S 2 S (where S now denotes the 
corresponding non-equilibrium thermodynamic potential in place of the lo- 
cal equilibrium entropy) contains terms involving these fluxes, as well as the 
more conventional thermodynamical variables, but not the velocity variables 
Written in terms of scaled variables it has the form 



Ps(a) ~ exp 



r 2 



2k B T 



-a\a\ 



j j 1 oj oj 
a 5 a 5 — 2 C V' C W 



" a /i+lO a H 
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J 3 
0-140-14 



}■ 



(27) 



Here the variables a 



_i and a-14 are scaled versions of the traceless stress 
tensor, the heat flux and the trace of the stress tensor, respectively. The result 
( |27|) suffers from the same defect as (!20l) . but if we now include the velocity 
variations in 5 2 S then we again obtain (|2T|) . but now with b = 1, . . . , 14. 
Therefore the matrix E can be consistently identified, and again is given by 



4 VELOCITY FLUCTUATIONS AND THE 
LIAPUNOV FUNCTION 

Finally, within the context of LIT or EIT, we can investigate the claim that 
S 2 Z is a Liapunov function, but that 5 2 S can no longer be adopted as a 
Liapunov function when velocity is included as a dynamical variable |4J. In 
the language we have been using in this paper, the former is 5 2 S and the 
latter is S 2 S\ V , and this is the notation we will use in what follows. To 
investigate whether these functions are Liapunov functions, we begin from 
the form of 5 2 S sufficiently near equilibrium that LIT will apply: 

6 2 S = -^al(t)al(t). (28) 
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Here the a b are averaged variables, that is, non-fluctuating variables which 
obey the hydrodynamic balance equations. From Eq. (1281) we see that S 2 S < 
with equality if and only if a b (t) = 0. Differentiating Eq. (1281) with respect 
to time gives 

| (5 2 S) = -^(*K(t) = 2 ^G£al{t)a{{t) 

= ^fSl k c a k c (t)ai(t), (29) 

where S bc is the symmetric part of G J bc . Using the expressions for S bc , Eqs. 
( 124"1) and (1251) . and integrating by parts gives 



d / _\ 2c^ f , ( o o \ da$ da$ \ . . 

it V s ) = wJ dt ( 2 " + a ^s; J £ ■ (30) 

where we have gone back to an explicit notation for the continuous space 
variable r. In Eq. fl30l) . X,( and fi are the thermal conductivity, the bulk 
viscosity and the shear viscosity, respectively, D^ v is the symmetric part of 

o 

the scaled velocity gradient and Dp U its traceless form: 
_l(d^ da^A ° _1 

This shows explicitly, when 5 2 S is defined in terms of the averaged vari- 
ables, that it is a Liapunov function, as suggested by Glansdorff and Pri- 
gogine [I]. However, this calculation is identical to one carried out in Ref. 
[9], where dS/dt was evaluated and shown to be non-negative. Since all of 
these calculations have been carried out in the linear regime, and dS/dt = 
(l/2)d{6 2 S)/dt = (l/2)d(5 2 Z)/dt this is not surprising. Note that the in- 

o 

equality in Eq. ( |30l) is an equality if and only if Dpv= 0, n w = and 
das/Ox^ = 0. From the constitutive relations for LIT this corresponds to 
the vanishing of the traceless stress tensor and its trace and of the heat flux. 
This condition corresponds to the thermodynamic equilibrium state and it 
is equivalent to the condition a b (t) = found when S 2 S given by Eq. (128|) is 
equal to zero. 

A similar calculation may be carried out for EIT. In this case Eqs. ( 1281) 
and (1291) also hold, but now with the indices b and c running from 1 to 14. The 
form of the S{ k are different for EIT — in some ways they are simpler, since 
they do not involve derivatives, and so no integration by parts is required 
to obtain an explicit expression for the time derivative of 5 2 S. Using the 
expressions for S bc given in Ref. [12] for EIT one finds that 

_ (pS) = ^ J dr {^t 2 1 a^dvp +r^ 1 a 1A a 1A + rf 1 a A n- 10 a Af+1 o^ > , 

(32) 
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where the r,, i = 0, 1, 2 are the relaxation times of the various fluxes. Once 



again S 2 S is seen to be a Liapunov function, with the inequality in Eq. 
becoming an equality if and only if a^ v = 0, a« = and a M+ io = 0. These 
are just scaled versions of the traceless stress tensor and its trace, and of the 
heat flux, and so equality is obtained when these vanish, just as for LIT. If 
we use this method to try and show that 5 2 S\ V is a Liapunov function, we 
find, for example in the case of LIT, 



5 2 S 



T (a{(t)a{(t) + 4(t)4(t)) , (33) 



To 

and differentiating with respect to time gives 

j t (5 2 S\ v ) = (a{(t)a{(t) + 4(t)4(t)) 



T 

^ (G{ k c a k c (t)4(t) + G{ k c a k c {t)am) • (34) 



Substituting the actual expressions for G J b k [HJEI2] in Eq. flMl) . does not give 
an expression which is manifestly positive semi-definite. This is no doubt 
what Glansdorff and Prigogine meant by saying that S 2 S loses its properties 
as a Liapunov function when velocity is included as a dynamical variable. 
However, since we are assuming that v is fixed in the definition of 5 2 S it 
might be more consistent to take v to be a constant in the balance equations. 
If we do this we find that only the third term in the parentheses in Eq. (|30|) 
is present. It now follows that d(5 2 S\ v )/dt > 0. 



5 CONCLUSIONS 

In summary, when studying fluctuations in irreversible thermodynamics us- 
ing the formalism of Langevin or Fokker-Planck equations, velocity is in- 
cluded as a variable. When making use of the Einstein-Boltzmann relation 
to determine the exact form of the fluctuation-dissipation relation the form 
of S 2 S where velocity variation is allowed must be used. Although S and SS 
may be written in forms that do not involve velocity, 5 2 S does depend on 
the velocity variation. If, as some authors do, 5 2 S is taken not to include 
velocity variations — using what we have called S 2 S\ V — then these velocity 
variations have to be introduced by some other means, for example, by the 
introduction of the Z function. However, in this case an added postulate of 
the form P$ ~ exp {5 2 Z/2kB} has to be introduced. Clearly, this is unneces- 
sary since the usual Einstein-Boltzmann relation, with the correct use of 5 2 S, 
that is, including velocity variations, may be used without contradiction to 
complete the link between thermodynamic and hydrodynamic fluctuations 
and the theory of stochastic processes. 
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